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We consider the problem of stochastic flow of multiple particles traveling on a closed loop, with a 
constraint that particles move without passing. We use a Markov chain description that reduces the 
problem to a generalized random walk on a hyperplane (with boundaries). By expressing positions 
via a moving reference frame, the geometry of the no-passing criteria is greatly simplified, with 
the resultant condition expressible as the coordinate system planes which bound the first orthant. 
To determine state transition probabilities, we decompose transitions into independent events and 
construct a digraph representation in which calculating transition probability is reduced to a shortest 
path determination on the digraph. The resultant decomposition digraph is self-converse, and we 
exploit that property to establish the necessary symmetries to find the stationary density for the 
■ process. 
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I. INTRODUCTION 



■ In protein controlled diffusion through a membrane, the narrow passage forces the transported molecules to move single- 
file. A similar phenomena develops in the motion of people along multiple serving stations, such as occurs in a buffet 
line. Motivated by the natural problems that develop when physical objects try to move independently along the same 
path, we consider a stochastic flow of particles on a closed loop, with the constraint that one particle may not pass 
another. We limit this paper to the specific problem where motion occurs over discrete units of time, and the particles 
are limited to move in some integer number of steps. We expect that our approach may have some applicability to 

J^T) , models of microscopic transport, cellular automata models of traffic flow, and some queuing theory problems, as well as 

■ providing some general insight on diffusive flows in constrained channels. 

ON \ Problem Statement. Consider a warehouse with parts stored in n locations (parts bins) arranged in a closed path. 
k workers move around the warehouse in a continuous loop, filling an order on each trip through the warehouse. In real 
' life, a worker would collect from those bins which contain the parts required to fill an order. We make a simplifying 
, assumption and model this selection process as a Bernoulli trial, with probability s that the worker will select a part 
from any given bin. All the workers move in the same direction as they fill their orders, but without passing each other, 
"j^ , (Perhaps they are all driving forklifts, and there is no room to pass; or maybe the workers are actually robotic carts 

■ moving on a common track.) To define "time," we assume that during one time step, each worker moves around the 
' closed loop until one of two conditions is met: 



1. The worker has a Bernoulli success at some bin and stops to collect a part, or 



2. The worker is "blocked" from proceeding around the loop by some other worker who has stopped to gather a part. 



Since passing is not allowed, the first worker does not have a Bernoulli success during that time step and collects 
no part. 

Blockages, therefore, represent reduced output from a worker. Our goal is to evaluate the efficiency of our warehouse 
by determining the expected value of the fraction of the time steps that an individual worker is blocked. 

We apply the theory of Markov chains to this problem, which leads to a description of the process as a k— 1 dimensional 
generalized random walk on a compact lattice. We develop the state space description in a moving reference frame, 
where the constraint of single file motion can be simplified to a boundary condition expressible as a coordinate plane. 
To determine transition probabilities, we develop an associated digraph that allows us to decompose transitions in a way 
that relates transition probabilities to shortest paths between vertices of that digraph. We then exploit the self-converse 
structure of that digraph to establish a stationary density on the state space. The paper is organized as follows: in i^J 
wc define and enumerate the states; in flllll we develop an expression for the transition probabilities; in fllVl we establish 
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a stationary distribution for the general problem; and in 
statement. 



[V]we answer the specific efficiency question of the problem 



II. LABELING AND COUNTING STATES. 



Markov Chain theory requires that the probabilities of future states of the system depend only upon the current 
state of the system, so the initial step in applying these techniques is to identify a state space description that satisfies 
this requirement. Since all the bins have the same probability for selection, a blockage event does not depend upon the 
specific bin location of the worker, but rather it is the distance from one worker to the next that is of critical importance. 
Therefore, we focus on these distances to provide a state space description. Let 

d = w — z (mod n) 

be the distance from a worker at bin z forward to a worker at bin w (in the direction of motion of the workers) . We 
specify that two different workers may not occupy the same bin, so d > 1. We let X — (x%, ...,Xk), X 6 R fe , with Xi the 
distance from worker i forward to worker i + 1 (mod n), and we say that vector X defines a physical configuration of 
the system (or simply configuration). This vector description can be viewed as using a moving reference frame (moving 
with the workers), which replaces the fixed frame of the bin numbers. Each configuration is actually an equivalence 
class of bin locations for the workers. Fig^provides a visual example of this method of configuration identification. 
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FIG. 1: A warehouse of n = 16 bins. The positions of the k = 4 workers are shown in circles. Note that x\ + X2 + x$ + 14 = 
3 + 6 + 2 + 5 = 16 — n. The bin locations of the four workers in the fixed frame, (2, 5, 11, 13) is a member of the equivalence class 
denoted by configuration (3,6,2,5). 

Since the workers are restricted to a warehouse of n bins, we have y^._ 1 Xi = n. Counting configurations is simply 
the problem: how many ways can you arrange k positive integers that sum to n? This well known problem, generally 
covered in a first course in combinatorics, yields the formula 



C{k,n) = 



n — 1 
fc-1 



(1) 



possible configurations. To extend the set of configurations to describe all the states of the system, we must consider 
blockages. In a blocked situation, the blocked worker is physically a distance d = 1 from the worker ahead. The physical 
configuration is the same in both cases. The difference, however, is that at the bin where he is stopped, the blocked 
worker had a Bernoulli failure instead of a Bernoulli success (and therefore does not collect a part on that time step). 
To distinguish this condition, we use the symbol 1* to represent that blocked condition. Fig [21 illustrates this difference. 



By defining |1*| :— 1, we can formally represent states as vectors: 

k 

X = (x 1 ,...,x k ) x t G {1*,1,2 n-Hl}, 



(2) 



Geometrically, the blockage condition forms a boundary on the configuration space, where these boundaries can be 
treated as hyperplanes that are parallel to each of the coordinate planes. 1 The simplicity of this boundary expression 



Alternatively, we could have used instead of 1* to represent a blockage, which makes it easier to interpret the blockage states as the 
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FIG. 2: With k = 2 and n — 8, we see two possible transitions from the state (4, 4). The Bernoulli trial results are indicated with 
F for failure and S for success. Both transitions end in the same physical configuration. However, in the second case, worker 1 
does not have a Bernoulli success before he is forced to stop because he cannot occupy the same bin as worker 2. In this second 
case, worker 1 would not collect a part. 



results from our having shifted to the moving coordinate system. In a fixed reference (with states described by bin 
locations) , the geometry of the blockage state becomes significantly more complex as k increases [2j • 

We enumerate the blocked states as follows: Suppose we want to count the number of states with b blockages. An 
arbitrary state can be considered an ordered list of k elements, and we seek to count the number of valid ways to fill 
those k elements. Forming such a sequence can be broken down into two steps: first, place a 1* for each worker that 
is blocked; and then fill the other elements with positive integers to satisfy the summation constraint of There are 
(,) ways to insert the 1* s into the stream. The other k — b elements must by filled with positive integers that sum 
to n — b. We use with new arguments (k — b) and (n — b) to count the possibilities for the other integers, which is 
(tZfcZi) • Applying the multiplicative rule of counting, we find N, the number of states with b blockages, is given by 



Example. Let k = 5 and n = 16. An arbitrary state is (□, □, □, □, □). Suppose b — 2. We must place two l*s into five 
possible slots; there are (j) ways to do so, and (□, □, 1*, □, 1*) would be a specific choice. We now must fill the other 
three positions with positive integers which sum to 14, and there are ( 13 ) ways to do so. Then N(2, 5, 16) = Q) ( 13 ) = 780. 

To count the entire state space, we simply sum over all possible values for b. (We note that the maximum number 
of blockages is b = k — 1, since one worker must be stopped in order to block the other workers.) The total number of 
states would be given by 

M(* > n) = ^(6 l fc > n) = g(J)g:J: i 1 ). (4) 



III. TRANSITION PROBABILITIES 



Given the state description of S^J we number those states from 1 to M. To establish the Markov property, we must 
identify the transition probabilities 

Pij — P [System in state Xj at time r + 1| System in state Xi at time r] . (5) 

(For our general problem, there is no obvious scheme for a preferred numbering of the states. Therefore, we develop 
transitions probabilities as pxy, the probability of transitioning from state X to state Y, and identify pij = px t x ■■) 
First, we will consider only the transitions between unblocked states, and then we extend that formulation to describe 
transitions from and to the blocked states. 



coordinate hyperplanes Xj = forming the boundary of the physical configurations which lie strictly in the first orthant. We find the 
1*| = 1 symbology more useful in providing an algebraic and physical description of the state. 
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A. Transition probabilities for unblocked states. 



Recall that s is the probability of Bernoulli success, and let q = 1 — s. We decompose a transition from unblocked 
state X to unblocked state Y into a sequence of independent events: 



Each worker has Q After one worker has stopped, the 

bernoulli failures be- other workers have additional failures 

fore one of the work- All workers have to move the system from configuration 

Event: ers has a success. one success. X to configuration Y. 

Probability: q kQ s k f{X,Y) 

We compute the transition probability by taking the product of the independent events and summing over all Q to give 



Pxy = £ q kQ s k f{X,Y) = s k -—^f{X,Y), (6) 

Q=0 q 

where f(X,Y) remains to be specified. We call f(X,Y) the arrangement probability, and note it is a conditional 
probability (conditioned upon one of the workers having stopped). Our visualization is that all workers simultaneously 
move to an adjacent bin and conduct a trial. If all workers have failures, they would all index by one bin and repeat. 
Until the first success, the physical configuration does not change. However, when one of the workers has a success, 
that worker stops, and the other workers keep moving. The change in configuration is the result of workers moving - 
Bernoulli failures. Therefore, f(X, Y) = q , where I is the total number of bins that the workers must pass to take the 
system from configuration X to configuration Y, given that one of the workers passes bins. We use a geometric and 
graph theoretic approach to resolve the problem of counting these Bernoulli failures. 

Background geometry to address arrangement probability. Let X be an unblocked state - a fc-tuple of 
positive integers which sum to n. Then X lies on the hyperplane in R fe given by YJ<=i x i ~ n > with orthogonal vector 
u = (1, . . . , 1) G R k . Specifically, X is a lattice point in the first orthant that lies on that hyperplane. Define vector 
V r = (vi, . . .,v k ), by 

I „ ;„ i 1 „■ 

(7) 

Geometrically, each V r specifies a vertex of the polytope containing all the configurations. FigOlillustrates this geometry 
for the case k — 3, n — 7: Fig|3Ji shows how the hyperplane and lattice points are situated in R 3 , and FigEb shows 
the view from a position orthogonal to the plane, illustrating the structure on the in k — 1 = 2 dimensional subspace. 
Vertices V 1 are labeled on both figures. 




FIG. 3: Visualization of states for k — 3, n — 7. 



We define Q to be the convex hull of {V r : r = 1, . . . , k}. For 1,7 e O, we define A XY = (di, • • • , d k ) := Y - X. 
Since ^ = YJ — n, a necessary condition for A is 



(8) 
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Geometrically, each Axy is a lattice point on the hyperplane orthogonal to vector u = (1, . . . , 1) that passes through the 
origin. We call this hyperplane V . We seek to describe f(X, Y) in terms of some function g(AxY), with g(-) independent 
of X and Y. The justification for this approach is that if no blockages occur, the workers are not affected by each other. 
The rearrangement probability can be completely characterized by the change in spacing between workers, independent 
of the initial and final configurations. If such function g exists, then the process can be treated as a generalized random 
walk on R fc_1 (the hyperplane dimension). The physical configurations simply characterize which A vectors are feasible, 
because we require X + A — Y £ f2. Since X , Y, and f2 are contained within a bounded set, our description becomes a 
random walk with boundary. 

Canonical representation of A. Suppose X describes a configuration. If worker i + 1 has a Bernoulli failure and 
moves one bin, then the distance from the worker behind has increased by one, while the distance to the worker ahead 
has decreased by 1. The new configuration X would be given by 



Xi — Xi -\- 1 

Xi+i = x i+ i - 1 



X j ~ X 3 



Motivated by this effect of a single Bernoulli failure, we define vectors Si = (6n, . . . , Sik), where 

(1 Q=\ 

5ij = < —1 j = i + 1 (mod n) . 
[ else 

[Example: S3 = (0, 0,1,-1,0,..., 0).] We note that {^i}^ =1 C V, and span ({ ^j}^ =1 J = V . These spanning vectors have 

a natural representation as edges in a digraph which connect the configurations that result from a single Bernoulli failure. 
We call this representation the rearrangement digraph. Fig Q shows the rearrangement digraph for k = 3, n = 7. 



FIG. 4: A digraph representation of rearrangements for k = 3 and n = 7 using 8 vectors. Each edge represents the effect of a 
single Bernoulli failure by one worker. 

Any point A € V is a linear combination of the SiS, so there exists vector a with integer components such that 

k 

A = J2<*i6i. (9) 

i=i 

Since V is k — 1 dimensional, the representation is not unique. However, we want that decomposition to satisfy some 
additional constraints: As previously stated, rearrangement probability is conditioned upon one of the workers having 
no failures. Therefore, otj = for some j S {1, . . . , k}. There are at most k representations that satisfy this requirement. 
We also need the representation to be a path in the rearrangement digraph, which implies oti > for all i. The following 
paragraphs describe the algorithm that identifies this canonical representation. 

Construction of canonical representation. Define matrix Akxk = [ Si, ... ,6k] , where the 6iS form columns of 
A. Solutions to © arc equivalent to solutions of Aa — A. We note that rank A = k — 1, so A is singular. It is easy to 
verify that the eigenvector for eigenvalue A = 0isu=(l,...,l). The one parameter family of solutions to © is given 
by 

a = a° + tu, (10) 

where a is any solution to © and t an integer. 

The geometric interpretation of a is that each a describes a path associated with the displacement A, and each 
describes how many steps we take in the 6i direction when traversing that path. Since we want the decomposition to 
represent a valid rearrangement of the workers, we seek vector (3 such that 

A(3 = A , ) 

/3 t > Vie{l,...,k}, and \ . (11) 

0j = for at least one j E {1, . . . , k}. J 



() 



To construct this vector (3, we proceed as follows: Define 7 := (71, ... , 7&), where 



7j 



= £*• 



(12) 



From (JSJ) , we see that 7^ = 0, simplifying the computation which verifies that 



A'f = 



71 - 7fc 

-71 + 72 
-7j-i + 77 



di + 
-di + (di + d 2 ) 

d, + ELi d, 



dj 
d 2 



A. 



(13) 



In general, 7 will not satisfy the second and third elements of To find the desired solution, we define 7 m i n = min7i, 

i 

and assign = 7.; — 7 m i n . Clearly, all of the components of (3 are non- negative, with /3j — if 7 achieves its minimum 
at j. In vector form, = 7 — r y m inU. Since A7 = A, we use (I1UII to see that (3 must be the solution to 1111) . 

Example: Let k = 5 and n = 12. Suppose X = (2, 1,4,4, 1) and Y = (3, 1,2,2,4). Then A = Y-X = (1,0,-2,-2,3). 
We first find a solution to Aj = A by using Ijl2(l to find 7 = (1, 1, —1, —3, 0). Since ^min — —3, we find (3 — (4, 4, 2, 0, 3). 



Pi gives the number of Bernoulli failures required of worker i + 1 to achieve the rearrangement specified by A, and 
\\f3\\ = ^2 Pi gives the total number of failures to achieve rearrangement. 2 Since any other rearrangement a — P + tu 
that describes A would result in either negative components of a, (for t < 0) or all components positive (for t > 0), 
both of which would fail to satisfy (|11J) . the representation is unique. Additionally, any other path representation would 
require t > and ||a|| > \\P\\- Therefore, \\P\\ describes the shortest path length. We define 0(A) = \\P\\, where /3 is the 
unique vector satisfying l|ll|) . We now can state that the rearrangement probability is given by 



f(X,Y)=g(A XY ) = q 



_ J«A X y)] 



To simplify notation, we let Uj — (^(AxiXj)- Then 



1 



Pij 



-M 



1 -q k 

gives the transition probability from an unblocked state to an unblocked state. 



(14) 



B. Transition Probabilities for Blocked States. 



Transition probabilities from blocked states is trivial: since the system does not care about past Bernoulli trials, 
transition probabilities depend only upon the initial configuration, not whether that configuration was the result of a 
blockage. So if we define a subtraction operation of 1* by m — 1* := m — 1, and calculate A using that arithmetic, 
transitions probabilities from blocked states are the same as the transition probability from the unblocked state of the 
same physical configuration. 

To determine transition probabilities to blocked states, we note the following: when worker j is blocked, his final action 
is the result of a Bernoulli failure, with no Bernoulli success. So if we compare the two transitions from some state Y, 

T\ . Y > (xi, ■ ■ ■ , Xj—i, 1, Xj+i , ■ ■ ■ , Xk) 
T 2 : Y -»• (xi,...,Xj-i,l*,Xj + i,...,Xk) ' 

we can express one transition probability in terms of the other. Specifically, 

P[T 2 ] = P[T{\ ■ ^, (16) 



2 In this paper, the only vector norm used is the 1-norm. For ease of notation, we drop the subscript notation for vector norms. 
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indicating that regardless of the specific collection of motions of the workers, transition T2 requires one fewer success and 
one additional failure when compared to the T\ transition. We apply l|16l) recursively to (|14|l (once for each blockage) 
to yield: 

P« = ^ r ^ s g , «, (17) 

where r — q/s and bj is the number of blockages in state Xj. This formula reduces to l|14|) when bj — 0, and therefore, 
it applies to all transitions. 



IV. STATIONARY DISTRIBUTION 



A direct approach for finding stationary distributions is to develop a state transition matrix, P = \pij] ■ Then the unit 
left eigenvector of P associated with eigenvalue A = 1 gives a stationary distribution of the statesjij- However, finding 
such eigenvectors for a general problem is difficult unless P is very well structured. Although we have a formula for 
Pij, we can find no "good" ordering of the states, where we interpret "good" as giving enough structure to the state 
transition matrix to directly determine the eigenvector for the general problem of k workers and n bins. 

Often, finding general solutions requires some insight (in other words, a good guess). Some of the observations that 
lead to a "good guess" for this problem are: (1) since the probabilities are the same for each worker, we expect significant 
symmetry in the problem, (2) the A vector description of transitions yields a random walk, and we see no reason for 
the random walk to prefer any particular unblocked state, and (3) blocked states are closely related to the associated 
physical configuration, acting like boundaries on the state space, and that relationship is governed by the ratio r = q/s 
and the number of blockages. So motivated, we postulate an initial distribution and show that it is stationary. 

Postulated density and outline of proof of stationarity. Let {A^}^ be the collection of all the states and bi 
the number of blockages in state Xi . Define 

c^ = A (18) 
We will treat these as weighting values for the density in each state, and let 

(19) 

be the initial distribution of states. We want to show that v is stationary, or equivalently, that Vj = fiPij for 

all j. One way to describe this balance is to say that at each time step, the density that transitions from state Xj to all 
states is exactly equal to the sum of all the density that transition into Xj. To establish the required balance, we will 
prove the following logical argument: 

1. Regardless of the density at time t, at time r + 1, the density of a state X with b blockages is r b times the weight 
of the unblocked state which has the same physical configuration as X. 

2. Each unblocked state can be placed in a one-to-one correspondence with another unblocked state, (which we call 
the co-state) that has the property that when the density is the density that transitions into the state is the 
same as transitions from the co-state. Since v assigns the same density to all unblocked states, the implication is 
that v is stationary on the unblocked states. 

3. Since the densities of the blocked states are completely determined by item (1) (which is satisfied by v), stationarity 
of the unblocked states immediately implies stationarity of the blocked states. 

The first element of the proof is strait-forward. 

Lemma 1 [Item (1)] Let W b be a state with b blockages and let W be the state with the same physical arrange as W b , 
but with no blockages. If the total density that is transitioned into state W is a, then the total density that transitions 
into state W b will be r b a. 

Proof of lemma. From repeated application of Ijlbjl , we know that for every state X, 

Pxw = r b pxw- (20) 



s 



Suppose the density of state Xj at time r is Let 

i 

be the total density transitioning into W. Then the density transitioning into W b is 

to Xi w» = & b p*iW = rt>a - D ( 21 ) 

i i 



Item (3) of the proof follows directly from items (1) and (2), so the crux of the argument is rigorously proving 
that the unblocked states are stationary. Although an algebraic argument can be shown, it is essentially a tedious 
symbolic manipulation that fails to reveal the underlying structure. Instead, we will develop an proof that exploits 
(and illuminates) the symmetry that is visible in the graph theoretic description (the rearrangement digraph) previously 
introduced. 

Motivating, defining, and analyzing co-states. We want to show that Vj(r+ 1) = Vj{r)\ that the density of state 
j is the same at time r + 1 as at time r. Direct computation is intractable. Instead, we show that for each Xj, we can 
match in with another indexed state, Xj-« , such that Vj(r + 1) = Vj- (r). By assumption on v, we know that if both states 
are unblocked, then Vj{r) = Vj- (r), and we achieve our goal (for unblocked states). An alternate description is that we 
seek to find a state Xj- so that the density that the transitions out of state Xj- is the same as that transitioning into 
state Xj . Algebraically, we want 

M M 

Y^Vj*p j H = Y l ' iPi i- ( 22 ) 

i=l i=l 

We first consider a slightly different constraint than l|22[). Suppose we seek j* such that 

c c 

i=l i=l 

where the summation is over only unblocked states. Since i/j = Vj for all unblocked states, we can use l|14f) to simplify 
to 

c c 

^J^^.'] = £ g [« A *iM. (24) 
i=i i=i 

Since q is arbitrary, l|24|l requires the equality of two polynomial expressions in q, which implies that both the left 
and right sides must have the same collection of exponents. In the digraph representation, each exponent (0(A)) is 
determined from the shortest path length between vertices. So l|24|) will hold if the collection of paths going into Xj 
is the same as the collection going out of Xj-. When such a relationship holds, we call Xj- the co-state of Xj. Fig [5] 
illustrates such a pairing for our example problem, where Xj = (2, 1, 4), with co-state (4, 1, 2). 




FIG. 5: Using k — 3 and n = 7, rearrangements into state (2, 1,4) and from its co-state (4, 1,2) are decomposed by S vectors, to 
illustrate an equivalent set of pathlengths. 

Having now restated the issue as a graph question, we introduce the following definitions from graph theory: Q 

• A digraph D\ is isomorphic to digraph D2 if there is a one-to-one mapping (f> from the vertex set of D\ to the 
vertex set of D2 such that (it, v) is an edge of D\ if and only if (<I>it, $u) is an edge of Z?2- 
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• The converse of graph D, (written D ) is the digraph with the same vertex set as D, such that (u,v) is an edge 
of D if and only if (v, u) is an edge of D (The converse is formed by reversing the direction of each edge.) 

• A digraph D is self-converse if D is isomorphic to D. 

Lemma 2 Let G the digraph formed by taking configurations (unblocked states) as vertices and edges defined by the 
rearrangement resulting from a single Bernoulli failure S{. Then G is self-converse. 

To prove the lemma, we demonstrate the self-converse structure by providing the necessary isomorphism. 
Proof of lemma. For vertex X = (xi, . . . ,x k ) define map $ (and notation (-)*by 

X* :=<Z>{X) = (x k ,...,xi). (25) 

$ is clearly a one-to-one mapping of the vertices of G onto itself. Assume (X, Y) is an edge of G, (and, by definition, 

< — > 

(Y, X) is an edge in G .) Then X + Si = Y for some i. Since vector addition in R is defined component-wise, reversing 
the order of components (by applying $) does not alter the quality, so we have 

X* + 5f = Y*. (26) 

By referring to the definition of Si, one easily sees that 5* — —Sk-i- (Example: If k = 6, then 82 — (0, 1, — 1, 0, 0, 0), and 
82 = (0, 0, 0, —1, 1, 0) = —84.) Substituting into (|2fj|l and rearranging, we have 

Y* + 8 k ^ = X*, 

which implies there is an edge in G from Y* to X*. So (Y,X) an edge of G implies ($Y, $>X) is an edge of G. Since 
each step above is reversible, $ is the necessary isomorphism between G and G . □ 




FIG. 6: Using k = 3 and n = 7, the first graph is G, and the second is its converse, formed by reversing the direction of all 
the edges. The third graph is a simply a redrawing of the converse by reflecting the image over the hashed line. The reflection 
preserves the direction of adjacency between vertices, so the graph is preserved. The new redrawing more clearly shows that G is 
self-converse. 



We remark that the A:-fold symmetry of the graphs leads to k different isomorphisms that prove the self-converse 
property. However, we will consider (|25|l as defining co-states. The graphical structure from X* exactly matches the 
structure into X, which ensures l|24(l is satisfied and establishes the balance among the unblocked states. Moreover, the 
self-converse structure tells us that for any two unblocked states X and Y, 

PXY = PY'X* 

However to prove the unblocked states are stationary, we must demonstrate an additional balance between the density 
transitioning into Xj from blocked states with the density transitioning from X* to blocked states. 

Let W b be a state with b blockages and W the unblocked state with the same physical configuration as W b . We recall 
that transition probabilities from W b are the same as the transition probabilities from W (because the system does not 
have "memory" of how it got to some configuration). If the current density is v, then the density of W b is r b /||cL>|| (by 
definition of v). The density that transitions from blocked state W b to any unblocked state X is 



(27) 
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This is exactly the same as the density which transitions from X* to $(W b ), computed as follows: the density of X* is 
l/||o;||, so the density transition from X* to W* is j^Px*w* ■ We apply 120(1 b times to find that the density transitioned 
is 

1 r b 

ij— ur b p x *w = h— rrPwx- (28) 

IMI IN 

This additional balance of transitioning density allows us to conclude that under assumed density i>, the unblocked 
state density is stationary. To complete the proof, we invoke Lemma ^ to claim that the blocked states are stationary 
as well. Additionally, since pij > for all transition probabilities, it is known that the stationary density is unique 0. 

V. CALCULATING THE EXPECTED VALUE FOR BLOCKAGES. 

Finding the stationary density for a Markov process enables us to answer a myriad of questions regarding the asymp- 
totic behavior of the system. In particular, we are now ready to tackle the question of the original problem statement. 
Specifically, we seek to develop a formula for B(k, n, r) = the expected value of the fraction of the time steps for which 
a given worker is blocked. Since the problem is symmetric in each worker, without loss of generality, we analyze worker 
1. Vi gives the expected value of the fraction of the time spent in state i, so 



B{k,n,r) =£Vi, (29) 



ieA 

where A is the index of all the states when worker 1 is blocked. We note that 



Vi = FIT = Ti — iT' 30 

ImI IMI 

where bi is the number of blockages in state JQ. We first calculate ||w|| by applying J3}: 

ihi=e#,m)^£(j)(;: 6 :;)^. od 

b=0 6=0 ^ ' ^ / 

We now consider the set A : When worker 1 is blocked, the state is given by 

X = (l*,a; 2 ,...,x fc ). (32) 

So we may formally define 



A={j 



k \ 

,kk),^2\xi\ =n-l > . 

i=2 ) 



X j = (l*,x 2 ,...,k k ),y\x i \=n-1 } . (33) 



We note that for any state Xi,i £ A, the total number of blockages is exactly one more than the number of blockages 
in the 2nd through kth components. We can use our previously determined counting formulas, but with these updated 
arguments, computing N(b, k — 1, n— 1), where b may range from to k — 2. We then find that the frequency of blockage 
of worker 1 is given by 



, E(Y)(n b : 2 > b+1 



h=0 



[Note: the exponent r h+1 accounts for the formulation of one 1* in the first component and b l*s among components 

X 2 , ■ ■ - ,Xk] 
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VI. CONCLUSION 



In this paper, we considered the problem of single-file motion of multiple agents on a closed path. By using a 
moving reference frame of distance between workers (instead of actual bin location), we were able to simplify the 
geometry of the constraint. In the k — 1 dimensional state-space, the system reduces to a random walk with the 
coordinate planes as boundaries. Distinct from the usual state transition graph, we proposed a decomposition digraph 
for transitions that allowed calculation of transition probabilities. The self-converse structure of that digraph allowed us 
to identify the stationary density of the process. We expect that the geometric approach may simplify similar boundary 
descriptions of other single file diffusion problems. Additionally, we suspect that similar symmetries may be exploitable 
by decomposition of these processes into fundamental motion digraphs. 

The original motivation for this problem was an actual operations analysis question involving zoning arrangements 
to achieve maximum worker efficiency in warehousing systems. Our simplified expression of that problem (as stated 
in this paper) implies that workers may move arbitrarily far around the warehouse in one time step before achieving 
a Bernoulli success. We call this situation the "infinite travel speed" problem. As a more realistic model, one would 
consider an additional constraint that a worker could have at most / failures during a time step, since there must be 
some maximum speed of travel in a real system. The closed form description of the resultant stationary density remains 
an open problem. 
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